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Abstract Currently, the application of the network 
resources and various means of teaching such as multimedia 
into the classroom has led to the demonstration of 
multimodality in college English teaching. This paper 
analyzes the current status of college English teaching and 
the existing problems, elaborates the research trends of the 
theory of multimodal discourse analysis, and aims to explore 
the question as how to construct college English teaching 
model from the perspective of multimodal discourse. Under 
the multimodality-based college English teaching model, 
teachers should concentrate on cultivating students’ 
multi-literacy, coordinating different modalities, to achieve 
the teaching objectives. 
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1. Introduction 

Over the last few decades, the world we live in has 
witnessed significant changes both in the way of 
communication and in the approach to teaching and learning 
at colleges, due to the development of information and 
communication technologies. Currently, college English 
teaching in China uses a teaching mode combining 
independent study with computer and multimedia classroom 
teaching supported by network technology. The constantly 
increased media in the classroom makes education present a 
multimodality trend. The popularization of multimedia 
technology and network technology injects vitality into the 
reform of English classroom situational teaching. 
Information transfer mode is no longer confined to a single 
text. Instead, it includes multiple modes such as audio 
frequency, video and three-dimensional animation. These 
modern means enrich semantic expression forms, break the 
oneness of conventional media and reflects multimodality 
nature of communication. The ultimate goal of language 
teaching is to allow learners to know how to use a language 
for communication in a language environment where allows 
them to comprehend, practice and use language. In China, 


the domestic Scholar Zhang Delu [1] focused on discussing 
the use of system-functional linguistic theory to provide 
theoretical framework for multimodality discourse analysis 
and research and providing guidance on the selection of 
effective teaching process and practice for foreign language 
teaching practice under the condition of modern media 
technology. This also provides possibility for the 
establishment of college English teaching mode based on 
multimodality discourse analysis theory. New College 
English Course Teaching Requirements issued by Chinese 
Ministry of Education in 2009 requires colleges and 
universities to make full use of multimedia and network 
technologies, together with a new teaching mode to improve 
the traditional classroom teaching mode mainly involving 
teachers’ instruction. The establishment of multimodality 
college English classroom teaching mode is conducive to 
training students’ diversified literacy and abilities of 
listening and speaking and can effectively realize mutual 
coordination of different modes and jointly achieve the goal 
of college English teaching. 

2. Theoretical Basis and Exploration of 
Multimodality College English 
Teaching Mode 

2.1. Concept and Research Status of Multimodality 
Discourse 

Modality is an abstract language symbol system. Media is 
the physical device of symbol distribution and physical tool 
of expressing information. Media makes the abstract 
modality concrete. For example, visions, hearing, touching, 
smelling and tasting are five modalities, while eyes, ears, 
hands, noses and tongues are media. The application of each 
modality is realized through the corresponding medium. 
Multimodality is also called as multi-symbol, including 
spoken language, written language, image, diagrams, space 
and various kinds of symbol resources used to construct 
meanings. The application of multimodality is a 
phenomenon of communication through many kinds of 
devices and symbol resources. Multimodality is one of the 
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characteristics of the different discourses in modern society. 
In the digital information era, these different modalities 
function similarly in the level of meaning recurrence. 

In recent decade, the analysis and application of 
multimodality in teaching is one of the hot topics in America 
and Europe. R. Barthes, one of the earliest researchers in 
multimodality, issued the paper Rhetoric of the Image in 
1977, during which he explored the interaction between the 
expression of image and language. New London Group [6] 
was the first applying multimodality to language teaching. 
They thought the training of the students’ multi-literacy was 
the main task of language teaching. From then on, the 
researches concerning multimodality and language teaching 
began to prevail. Kress & van Leeuwen [5] studied the 
relationship between modality and media, and put forward 
the schemes and application principles of training 
multi-literacy under the setting of multimodality. Royce [9] 
researched the complementary of different symbols in 
multimodal discourse and the collaboration of multimodality 
in second language teaching. Guichon & McLornan [3] 
probed into the effects of multimodality on second language 
learners, and put forward the designation principles and 
ways of the curriculums of computer assisted teaching. 
Many scholars pay attention to the study of PPT 
demonstration in class. Fisher [2] posed some questions of 
the application of PPT in class. Nouri & Shahidy [8] made an 
empirical study and explored the relativity between the 
students’ attitudes and memorization when teaching the 
knowledge of theories. Compared with what has been 
achieved in the West, the study of multimodal discourse in 
China is at its infancy. The earliest study concerning 
relationship between multimodality and foreign language 
teaching are Gu and Flu. Gu [11] distinguished between the 
two concepts of multimedia study and multimodality study, 
and constructed a model used to analyze the two kinds of 
studies. Hu [12] discussed the differences between 
multimodality semiotics and multimedia semiotics, and 
introduced computer semiotics with double characteristics of 
media and modality. Li [13] studied multimodal discourse 
theory by using the linguistic theory of systematic function. 
Zhu [10] explored the implications of multimodality to 
teaching reform in China. Zhang [1] established a 
comprehensive frame for the analysis of multimodal 
discourse. He pointed out that the study of multimodality in 
China was at its initial stage, and especially there were fewer 
researches on the most frequently used PPT in class. PPT, as 
a form of multimodality, plays an important role in foreign 
language teaching and Chinese students’ English learning. 
The study of PPT can support the theory and practice of 
foreign language teaching in China, and accelerate the 
process of foreign language teaching reform, enrich the 
theories of multimodal discourse analysis. 

2.2. Theoretical Basis and Exploration of Multimodality 
College English Teaching Mode 

From what has been discussed, multimodality discourse 
theory could work well for establishing Multimodality 


college English teaching practice. Modern college English 
class has widely used PPT software for multimedia teaching. 
The use of multimodality discourse theory has provided 
scientific methods for rational analysis on classroom 
teaching quality. In this paper, the comprehensive 
framework of multimodality discourse analysis of Martin [7] 
and Zhang [1] is adopted as the theoretical basis of 
multimodality college English teaching mode. Zhu [10] and 
Zhang [1] described in detail that system-functional 
linguistic theory has opened new perspectives for 
multimodality discourse research. According to the research 
of Martin [7] on multimodality discourse, the theoretical 
framework of multimodality discourse analysis is mainly 
composed of basic factors and conditions of system and 
selection at five levels, i.e., culture, context, meaning, form 
and media (see table 1). 

Table 1. Theoretical Framework of Multimodality Discourse Analysis 
(Martin, 1992) 



Cultural 

level 

Ideology and types 

Theoretical 

Context 

level 

Scope, tenor and mode of discourse 

framework 

of 

multimodality 

discourse 

analysis 

Meaning 

level 

Discourse meaning, conceptual meaning, 
interpersonal meaning and textual meaning 

Form 

level 

Different formal systems of meaning, lexical 
grammatical system of language, visual 
ideographic object and grammatical system, 
auditory ideographic sound block and 
grammatical system, ideographic object and 
tactile grammatical system and relationship 
of grammar of each modality 


Media 

level 

Facial expression, gesture, body gesture and 
action; PPT, laboratory, network platform, 
material object(projection), sound and 
simultaneous interpretation room etc. 


Zhang [1] conducted a systematic research on 
multimodality discourse analysis according to Halliday’s 
system-functional linguistic theory and put forward the 
theoretical framework of comprehensive analysis on 
multimodality discourse (see fig. 1). According to the figure, 
this framework is divided into four levels: culture, context, 
content and expression. Content level integrates meaning 
and form levels of theoretical framework of multimodality 
discourse analysis put forward by Martin [7] and highlights 
correlation of formal characteristics of different modalities. 
It’s worth noting that each level of the comprehensive 
framework of multimodality discourse analysis has 
coordinated, correlated and complementary relations. 
Currently, multimodality discourse research still focuses on 
formal characteristics of different modalities and their 
relation. This paper attempts to establish multimodality 
college English teaching mode according to the 
comprehensive framework of multimodality discourse 
analysis of Martin [7] and Zhang [1], discusses how to 
realize mutual coordination and harmonic unification of 
teachers and students in the college English classroom and 
culture, situation, content and expression levels, effectively 
train students’ diversified literacy and abilities of listening 
and speaking and jointly improve teaching efficiency. 
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Figure 1. Comprehensive Framework of Multimodality Discourse Analysis (Zhang Delu, 2009) 


3. Establishing Multimodality College 
English Teaching Mode 

3.1. Concept of Multimodality College English Teaching 
Mode 

Multimodality college English teaching means that 
teachers start from the perspective of multimodality 
discourse analysis, fully understand students’ cognitive 
psychology and their role in class. After that, teachers are 
supposed to select teaching situation and act as students’ 
self-study guidance. Meanwhile, teachers should construct 
meaning with the help of multimodality symbolic resources, 
appropriately handle the coordination of multiple modalities 
at culture, situation, content and expression levels, integrate 
their speech, posture and multimodality classroom teaching 
environment presented by multimedia, through which the 
harmony among teachers, students and multimedia in college 
English classroom could be finally realized. Teachers should 
focus on training students’ diversified literacy and ability of 
comprehensive language application, pay attention to mutual 
coordination of different modalities and complementation of 
different teaching means in the process of teaching practice 
and jointly improve the quality of college English teaching. 

3.2. Requirements of Multimodality College English 
Teaching Mode 

In the teaching process, teachers should select the 
meaning to be expressed according to specific situational 


context, including conceptual, interpersonal and textual 
meanings and help students to construct language discourse 
ability. To express appropriate meaning, teachers should 
learn to select the use of each expression level of multiple 
modalities. In college English teaching, teachers should 
appropriately use the complementary relationship among 
discourse scope (fields involved in the teaching content), 
discourse tenor (state of teaching objects and relationship 
between teaching objects and instructor) and discourse mode 
(teaching conditions and site etc.) at the situation level of 
multiple modalities, because multimodality college English 
teaching mode involves the coordination of internal media of 
modalities. In teaching reading and writing, teachers 
generally use the method of explanation, explain the 
meaning of discourse clearly and then use living examples 
for further explanation. Forms of media include book, PPT, 
oral teaching and question answering and so on. Modalities 
involved are visual sense (book and PPT) and auditory sense 
(oral teaching and question answering). For example, in 
listening and speaking teaching, teachers should make full 
use of resources provided by multiple modalities at culture, 
content and expression levels, put real communicative 
context in class and use images, videos and audios provided 
by auditory sense and visual sense modalities as actual 
learning environment, teaching form combining language 
and non-language use and role play to improve students’ 
ability of using communicative strategies in a real context. 

In multimodality college English teaching mode, 
classroom teaching and learning effect depends on the 
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coordination of internal media of modalities to a great extent. 
Language and image modalities are two favorable methods 
of teachers and students for constructing meaning. Giving a 
lesson is the coordination of visual sense modality and 
auditory sense modality. In multimodality discourse theory, 
language, auditory sense, visual sense and tactile sense are 
social symbols with their own meaning potential. They 
should be important modalities for constructing meaning. 
Teachers should guide students to use multimedia network 
resources to realize their understanding of knowledge and 
construction of meaning and meanwhile improve their 
mastery of language knowledge and ability of constructing 
language discourse. Teachers should appropriately use PPT 
resources and multimodality symbols to provide teaching 
situation, convenience and supplementary conditions for 
foreign language teaching in situational context in class so as 
to improve teaching efficiency. For PPT resources wisely 
used under multimedia, Hu [12] divided various discourses 
of PPT categories into four types: prompt type, intuitive type, 
analysis type and persuasion type and divided modalities 
used in PPT discourse into visual sense modality and 
auditory sense modality. Multimodality college English 
mode requires the use of multiple modalities in class to 
enrich the classroom content. Background music can rapidly 
color the atmosphere; images can intuitively attract the 
attention of students; text explanation can help students 
understand the knowledge content. Teachers’ body language 
and infectious explanations accompanied can improve 
teaching quality. Hu [12] also considered, “traditional 
literacy mainly focusing on reading and writing is not 
enough in multimedia era”. Today, with the integration, 
diversification and technicalization of the current world, it is 
not only required to train students’ reading and writing 
abilities, but more importantly, it is a must to train their 
diversified literacy. 

Let’s take the Integrated Course, a compulsory one in 
Chinese colleges for example. The teaching objectives of 
integrated course is to pass on knowledge, introducing 
culture and training language skills. Teachers will explain 
the content intensively, and students will do large amount of 
exercises to consolidate or digest what they are supposed to 
command. Usually, students are the center of the class and 
the main media ways are textbooks, multimedia courseware, 
teachers’ teaching activities, students’ question-answering 
activities, so the main form of modalities are vision and 
hearing. This kind of teaching pattern involves the 
collaboration between media inside the modality. 
Courseware shows the important information by using the 
vivid pictures and the different typefaces. Textbooks act as 
the supplement by providing the specific information. In the 
process of teaching, teachers will raise some questions for 
students to answer. The application of hearing modality 
needs vision to cooperate. Teachers can judge whether 
students understand the materials they are studying 
according to the students’ reaction. Therefore, in this kind of 
teaching model, over two modalities are applied, which 
accelerates the conveyance of information, and changes the 


previous unitary teacher-centered pattern of language 
teaching with the help of multimedia. The new teaching 
pattern is free from the constraints of the time and places, 
which embodies the central role of students and the 
interaction of learning. One teaching case could be raised to 
illustrate the importance of multimodal discourse employed 
in class. In the Text A, Book One of twenty-first century 
College English, the topic is Conversational Ballgames. In 
class, the teacher explains the different ballgames by 
demonstrating some pictures and background information 
via PPT, and compares them to Japanese-style conversation 
and English-style conversation. By discussing the different 
rules of the ballgames, the teacher elaborates the different 
language styles under the different cultural backgrounds and 
how the differences lead to a series of interesting results in 
the interaction between people. Through the demonstration 
of PPT, the students learn different styles and rules of 
conversation. Then the teacher divides the students into 
some group and asks them to discuss the different 
conversation styles and summarize the corresponding 
conversational rules and characteristics. After that, the 
teacher plays a piece of video in which an actress acts as 
people from different countries speaking different styles of 
English. The actress speaks with obvious characteristics of 
different countries and the students can identify the different 
styles easily. They are American, African, Chinese and 
Indian. Finally, the teacher poses a question: besides 
language, what other factors cause to form the 
conversational style? With the help of the previous video, the 
students list a series of factors, such as facial expression, 
body language, way of thinking, clothes and so on. Through 
the discussion and guidance above, the students understand 
that language reflects culture, so learning a language, one 
must learn the culture. Students should develop a right 
attitude toward language learning. In the process of learning, 
the students have a good command of this unit under the 
setting of multimodality. 

4. Conclusions 

This paper attempts to establish multimodality college 
English teaching mode based on the comprehensive 
framework of multimodality discourse analysis of Martin 
(1992) and Zhang Delu (2009). The research finds that the 
meaning of multimodality college English teaching mode is 
that it can integrate language and other relevant meaning 
resources. We can see not only the role of language system in 
the meaning exchange process, but also the effect of other 
symbol systems such as auditory sense, visual sense, picture 
and tactile sense modalities in this process, thus making the 
interpretation of discourse meaning more comprehensive 
and accurate and providing convenience for the realization of 
teaching situations in foreign language teaching. Research 
also finds that multimodality college English teaching can 
allow teachers and students to obtain information through 
multiple channels and jointly construct the meaning to be 
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expressed by teachers and the meaning to be mastered by 
students and is conducive to obtaining the optimal effect of 
teaching. The establishment of multimodality college 
English teaching mode cannot be accomplished in an action. 
It should be tested and improved constantly in the practice of 
college English teaching. This research aims at throwing a 
sprat, from which college English teaching practice could be 
more inspired. 
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